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Abstract 

In this paper we perform Bayesian estimation of stochastic volatility models 
with heavy tail distributions using Metropolis adjusted Langevin (MALA) and 
Riemman manifold Langevin (MMALA) methods. We provide analytical ex¬ 
pressions for the application of these methods, assess the performance of these 
methodologies in simulated data and illustrate their use on two financial time 
series data sets. 

Keyvifords: Bayesian, Markov chain Monte Carlo, Metropolis-Bastings, Value 
at Risk. 


1 Introduction 


Stochastic volatility (SV) models were proposed bv iTavloii (Il986l ). This model and 
its generalizations has been applied successfully to model the time-varying volatil¬ 
ity present in financial time series. To estimate these models several estimation 
met hods have been pro posed in the literature, quasi-ma ximum likelihood meth¬ 


ods (Harvey et al.l . Il994l ). generalized method of moments (jAndersen and Sorensen 


1996 ). Markov Chain Monte Carlo Methods (MCMC) (pi oneered by Jacauier et al 


19941 ) and Integrated Nested Laplace Approximations (jMartino et al.l . l2010l ). to 
na me a few. For an accoun t of r ecent developments in the estim ation of SV models 


see 


Broto and RuizI (120041 ) and IShephard and AndersenI ()2009l ) and the references 
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le most efficient esti- 


Kim et al. 


therein. In particular, MCMC methods are co nsidered one of t 
matiq n method. Proposals include for example 1.1acquier et al.l ()l994l ) and 

Jl998l i. 

Recently, iGirolami and CalderheadI ([20111) proposed a methodology based on 
Metropolis adjusted Langevin and Hamiltonian Monte Carlo sampling methods. 
These methods take advantage of the relationship between Riemann geometry and 
statistics to overcome some of the shortcomings of existing Monte Carlo algorithms. 
They provide evidence that some sort of local calibration in the MCMC scheme may 
lead to strong improvements in large dimensional problems. 

In particular, one of the examples discussed by these authors is the estimation 
of SV models with normal perturbations. Since these models often give rise to pos¬ 
terior distributions with high correlat ions the methods propose d can b e particularly 
useful for estimation. More recently, iNugroho and Morimoto (j2014l i presented an 
algorithm based on Hamiltonian Monte Carlo methods for the estimation of realized 
stochastic volatility models. 

In this paper we discuss the use Langevin and Modified Langevin methods to the 
estimation of SV models with t-Student and CED perturbations for the observations. 
We give the expressions, assess the performance and illustrate with two real data 
sets. 

Because the computational time is critical for stochastic volatility models we im¬ 
plemented a hybrid method in which a Riemann manifold MALA (MMALA) scheme 
is applied for the parameters and a MALA scheme is applied for the volatilities. In 
particular, all the computations in this paper were i mplemented using the open- 
source statistical software language and environment R (jR Development Core Team 
(120 o3)). 

The remainder of this paper is organized as follows. The models are presented in 
Section [2] and the methodology for estimation is discussed in Section [3l To assess the 
estimation methodology some Monte Carlo experiments are presented in Section [H 
Section [5] illustrates with empirical data, and some hnal remarks are given in Section 
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2 Models 


We consider the following Stochastic Volatility (SV) model, 

yt = /3exp(/it/2)et, (1) 

ht = (t)ht-i + r]t, (2) 

where {et} is a sequence of independent identically distributed (IID) random vari¬ 
ables with zero mean and unit variance, {rjt} is an IID sequence of random variables 
such that r]t ~ -V(0, cr^), rjt and et are independent for all t. In addition, we assume 
that (3 > 0 and \4>\ < 1. 

In the SV model, conditional to the information set Tt = ■ ■ ■}, the 

standard deviation of yt is given by, 

at = l3exp{ht/2). 


In Finance, if yt represents the t-th return then d/ is the vola tility at time t. 

The original formulation of the SV model bv lTavlod (jl986l l considers et following 
a standard normal distribution. However, many empirical studies indicate that 
this model does not account for the kurtosis observed in most financial time series 
returns. Consequently, several other error distributions have been considered. For 
example, we consider et following an Exponential Power distri bution (or gene r alized 
erro r distribution , GED) with zero mean, unit variance (see iBox and Tiad (jl973l l 
and 


NelsonI (|l99lh l with density function, 


A2i+Vi^r(l/z/) 2 

where = 2“^/^r(l/z^)/r(3/i^) and the shape parameter zz > 0. Important special 
cases are, the Laplace (or double exponential) distribution for iz = 1 and the standard 
normal distribution when v = 2. The kurtosis is given by r(l/iz)r(5/iz)/r(3/zz)^ — 3 
so that when u <2 this distribution reproduces heavy-tails. In addition, we consider 
et following a t-Student distribution with v degrees of freedom and density function, 



/(^t) 


1 r(e±i) r 

■\/'k{u - 2) r(|) \ v-2\ 


( 4 ) 


When iz —>• oo this distribution approaches the standard normal distribution. 
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3 Estimation 


Let yi,... ,ynhe the observed time series. In order to estimate this model we use the 
Metropolis adjusted Langevin (MALA) and the Riemannian M anifold Metropolis ad¬ 
j usted Langevin (MMALA) Monte Carlo methods proposed bv iGirolami and Calderhead 


([20111). The estimation procedure is performed in a two-step blocking approach. In 
the first step, the latent variables {ht} (the log-squared volatilities) are sampled and 
then, conditional on these sampled values, we sample the parameters 6 = (/3, a, cp, ly). 
At each step, a Metropolis-Hastings sampling scheme is applied using the methods 
described below. 


3.1 Metropolis adjusted Langevin algorithm (MALA) 

Let ^ G be the random vector of interest with density f{$). Then the Metropolis 
adjusted Langevin algorithm MALA is based on a Langevin diffusion process whose 
stationary distribution is /(^) and its stochastic differential equation is discretized 
to give the following proposal mechanism, 

^ = ^N + |v5ln/(^N) + ez (5) 

where 2 ~ N(0,1) with I the identity matrix of order D and e is the integra¬ 
tion step size. A Metropolis acceptance probability is then employed to ensure 
convergence to the invariant distribution as follows. A new value ^ is sampled 
from a multivariate normal distribution with mean /i(^t"'],e) = 
and variance-covariance matrix e^I. This value is accepted with probability given 
by min{l,/(^)g(^t"'l|^)//(^[”l)q(^|^t"'l)} where the proposal density is <?(4|^^”^) = 

This algorithm is then employed to estimate the SV model following the two 
steps below. 

(a) Sample the latent variables h. Assuming the parameters as constants, apply 
([5|) with / = f{y, h) and gradient V calculated with respect to h. 

(b) Sample parameters 0. Given {y,h), apply (|5]) with / = f{y,h\6)f{0) and 
gradient V calculated with respect to 6. 
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3.2 Riemann Manifold MALA (MMALA) 


Girolami and CalderheadI (j2nill ) developed a modification in the Metropolis pro¬ 
posal mechanism in which the moves in are according to a Riemann metric 
instead of the standard Euclidian distance. This procedure is refered to as Riemann 
manifold MALA or MMALA. The proposal mechanism is now given by, 




— e 


i=i 

.2 D 


+ 


i=i 


j ij 

d^j 


( 6 ) 


( 7 ) 


where 2 N{0,1) and, 


G{$) = -E 


( d^ln/($) \ 

V )' 


Then, employing a Metropolis mechanism with proposal density given by = 

e), and the usual acceptance probability given by the quantity 

min{l,ensures convergence to the invariant distribu¬ 
tion. We note that in this case both the mean vector and covariance matrix in the 
proposal distribution depend on the current state of the Markov chain. 

A simplified proposal mechanism is obtained when a constant curvature is as¬ 
sumed. In this case, the last two terms in ([7|) vanish and the proposal mean becomes. 




In this simplihed version of MMALA, the state-dependent covariance matrix in 
the proposal mechanism still allows adaptation to the local curvature of the target 
/(^) which has been shown to increase algorithm effi c iency in a number of applica¬ 


tions ([Girolami and CalderheadI (|201lh . 


Xifaraetal 


(|2014l L. This is the approach 


adopted here. We show in the simulation study that, in particular for stochastic 
volatility models, we have an efficient algorithm for estimation and prediction with 
a lower computational cost, which is important in practice. 

In our SV model this algorithm is then applied following the two steps below. 
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(a) Sample the latent variables h. Assuming the parameters as constants, apply 
(1^ with f = f{y, h) and gradient V calculated with respect to h. 

(b) Sample parameters 6. Given {y, h), apply ([6]) and (l7|) with / = f{y, h\6)f{6), 
gradient V and matrix G calculated with respect to 0. 

In Appendix Owe provide details on the required expressions of partial deriva¬ 
tives and metric tensors for both MALA and MMALA. Also, it is worth mentioning 
that matrix invertion is less computationally demanding in the SV model since G 
has a sparse tridiagonal form. 


3.3 Likelihood and Priors 

The log-likelihood = ln[/(y, li|0)] is given by 


f{y, h\(3, (j), cr, u) = f{hi\4>, a) f{ht\ht-i,(j), a) JJ f{yt\ht, I3, u) 


t=2 


t=l 


where a) ~ A^(0, cr^/(l — 0^)), ht\{ht-i, (f), a) ~ N{(f)ht-i, cr^). In addition. 




for GED errors and 


f{yt\ht,l3,iy) = 


/3A2i+iAr(l/i/) 


ht 

exp< - — 


2A" 


yt 


(3exp{ht/2) 


r(i^' 


1 + 


Vt 


- 2) r(|) \ _ 2)exp(ht) 


-{v+l)/2 


exp(-hj/2) 


for t-Student errors. 

Following the Bayesian paradigm we need to complete the model specification 


Liu 

(2001 

) and 

Girolami and G alder head 


( 2011 '). that is cr^ ~ Inv-x^(10,0.05), {(j) + l)/2 ~ Beta{20,1.5). In addition, we 
propose an Exponential distribution with mean one as the prior for (3. The prior for 
the tail parameter v depends on the distribution adopted for the error terms. For 
GED err ors we propose the prior fo r v ~ Inv-x^ (10,0.05) while for Student-t errors, 
following I Watanabe and Asail ([20011), we consider the truncated exponential density. 


f{i 2 ) = Aexp{-A(i/ - 4)} 
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for V > 4 and zero otherwise, as the prior for v. Differently from lWatanabe and Asai 
(2001) we specified A = 1/3. 

Denoting the joint prior density of B by '7r(0), the log prior is then given by, 


Lq = ln7r(0) = -/3 - ^ - llln(a) + 19In + 


+ ln/(i/). 


where hif{v) = — ^ — 31n(z^) for GED errors and ln/(z^) = ln(A) — — 4) for 

t-Stndent errors. 

It is worth noting that, in order to employ the algoritms described in the previons 
sections, we need to implement a transfor mation of a, d) and u to the real l ine. Here 
we set a = exp( 7 ) and 4> = tanh(a) as in iGirolami and Calder headi (j201l|), and we 
propose V = exp(p) and u = exp(p) + 4 for GED and t-Student errors, respectively. 
Of course this introduces Jacobian factors into the acceptance ratios given by ^ = 


exp( 7 ) = fj, ^ = 1 - tanh2(a) = 1 - 
t-Student errors ^ — 4- 


For GED errors, ^ = exp(p) = v and for 


4 Simulations 


To assess the methodology described in the previous section we conducted a Monte 
Carlo study. We generated m =1000 replications of 1000 observations from the 
SV model ([I|)-(I2]) with parameters P = 0.65, (p = 0.98 ari d tw o values for a. a £ 


0.05, 0.15}. These parameter values were used bv iLid (j200ll ) and 


Girolami and Galderhead 


201 ll ) among others. We considered three distributions for the errors: Gaussian, 
GED with parameter = 1.6 and Student’s t with u = 7 degrees of freedom. We 
then evaluated two estimation schemes: (i) MALA scheme for both the parameters 
and the volatilities and (ii) MMALA scheme for the parameters and MALA scheme 
for the volatilities (hybrid method). Since the vector of volatilities has the same 
dimension as the sample size (usually thousands of observations) we adopted this 
hybrid option instead of using MMALA for both parameters and volatilities. This 
is because computation time is relevant in real-life applications. 

The true parameter values were used as initial values for the MCMC samplers 
and the prior distributions are as described in Section 13.31 For each time series we 
drew 20,000 MCMC samples discarding the first 10,000 samples as a burn-in. 

To evaluate the performance of the estimation methods, two criteria were con¬ 
sidered: the bias and square root of the mean square error (smse), which are defined 
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as 


- HL 

bias = — (8) 

2=1 
^ m 

smse^ = —0)^, (9) 

2 = 1 

where is the estimate of parameter 0 for the z-th replication, z = 1,... ,m. In 
this paper we take the posterior means of 9 as point estimates. 

The estimation results are given in Tables 1 and 2. Overall the results are good. 

[ Table 1 around here ] 

[ Table 2 around here ] 

• Gaussian, good results in terms of bias and smse (all parameters). MMALA 
better excepting fro bias /? 

• GED. good results in terms of bias and smse (all parameters). MMALA better 
for /3 and v 

• Student’s t good results in terms of bias and smse for /3 and v but bad results 
for (j) and a. Maybe we need a large sample n = 1000? MMALA better 
excepting for bias /3 


5 Illustrations 


In this section we applied the described methodology to estimate two exchange 
rate time series data: the Pound/Dollar (£/USD) and the Canadian dollar /Dollar 
(CAN/USD). The time series under study are the daily continuously compounded 
returns in percentage, defined as rt = 100[log(Pt) — log(Pt_i)] where Pt is the price 
at time t. 

The £/USD time series retur ns covers the period from 1/10/81 to 28/6/85 and 
the SV model was estimated by iHarvev et al.l (119941 1 using quase maximum likeli¬ 
hood methods and by Durbin and Koopman [2001, pp 236] using quase maximum 
likelihood and Monte Carlo Importance Sampling methods. In both cases the au¬ 
thors assumed Gaussian errors. 





The CAN/USD returns are based on daily noon rates prices. The time series 
prices were obtained from the website http://www.bankofcanada.ca/rates/exchange/ 
and covers the period from January 2, 2007 to February 7, 2013. 

We have 945 and 2509 returns for the £/USD and CAN/USD time series, re¬ 
spectively. In Figures [Hand [2] we show the time series returns and Table 0] consigns 
some descriptive statistics. From this table, we observe a little skewness and high 
kurtosis, indicating asymmetric distributions with heavy tails. In addition, even not 
shown, the autocorrelation function indicates non serial correlation. 

Figured] around here 

Figure [2] around here 

Table 0] around here 


The analysis was done on the demeaned returns. For each time series, we esti¬ 
mated SV models considering the following three different distributions for the errors 
£t in the Gaussian, the GED distribution with parameter v and the Student’s t 
distribution with v degrees of freedom. 

For each time series we drew 150,000 MCMG samples of parameters and volatil¬ 
ities. We discarded the first 50,000 as burn-in and skipped every 25th resulting in a 
final sample of 4000 values from the posterior distribution. 

The estimated posterior means and standard deviations for each parameter are 
shown in Table [5] We can observe high persistence estimates (</>). In addition, we 
obtained moderate values of u the degrees of freedom in the t- Student distribution, 
indicating not too heavy tail^^. In particular, when comparing point estimates under 
MALA and MMALA schemes we note the following. 

• For the £/USD, estimates do not change under Gaussian errors but change un¬ 
der GED and Student’s t errors with a large change in v for Student’s t errors. 
The MMALA seems to be more efficient to capture heavy tail behaviour. 


• For the GAN/USD, estimates change slightly under Gaussian errors but do not 
change under GED errors. For Student’s t errors we notice changes in /3 and 
V and again the MMALA scheme managed to capture heavy tail behaviour. 


^The maximum likelihood estimates in 


Harvey et al. ( 1994) are 4> = 0.9912. = 0.0069 and 


7 = —0.0879, then a = 0.0831 and /3 = exp(— 7 / 2 ) = 0.9570. Durbin and Koopman (2001) report 
the following maximum likelihood estimates: (f) = 0.9731, o = 0.1726 and /3 = 0.6338 but do not 
report the bayesian estimates. 
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• The posterior standard deviations of v are a bit large corroborating the known 
fact that this parameter is often difficnlt to estimate. 

• The posterior standard deviations of /3 are also large for MMALA and Stn- 
dent’s t errors. 

Figure [3] shows the sample autocorrelations, sample paths and marginal posterior 
densities of parameters (3, a, (j) and v for the CAN/USD series using the MMALA 
sampling scheme under GED errors. The autocorrelations vanish fairly rapidly and 
the sample paths show relatively good mixing in the parameter space. 

Figure [3] around here 

Figure m around here 

Figure [5] around here 

In Figures m and [5] are showed the estimated volatilities exp(/it/2) taking the 
posterior medians of ht as point estimates. As can be seen, the volatilities follow 
very well the observed volatility clustering of returns. 

The performance of the proposed models and methods can also be assessed by 
estimating the Value at Risk (VaR) for multiple time horizons. From a Bayesian 
perspective, given the observed values of returns y = {yi,... ,yn} point estimates 
of the one-step ahead VaR could be obtained using a sample of values drawn from 
its predictive distribution, i.e. 

E{VaR^+,\y) ( 10 ) 

i=i 

(i) 

where is the predicted one-step ahead VaR in the MCMC iteration. Because 

they are not available analytically we adopt the following procedure. Given the 
parameter values and log-volatilities in the j-th iteration we obtain values of 
by drawing r\j and setting Next, we generate 

L replications ; ■ ■ ■ > ^n+i} from the error distribution (with tail parameter 
for Student’s t or GED distributions). Finally, we form a sample of returns by setting 
Un+i — which allow us to approximate V of confidence 

a by the negative value of the sample a-quantile. 
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For illustration, we estimated the one day 99% VaR for the last 252 observations 
(which covers one stock market year approximately) of both the £/Dollar and the 
Canadian-Dollar/Dollar time series. Since we wanted to reproduce a real scenario, 
the model parameters were estimated and the VaR calculated based on observations 
yi,..., yn- 252 +i-, i = 0,..., 251. Consequently, we estimated the model 252 times. 

Figure [6] shows the last 252 returns and the VaR estimates using our hybrid 
MMALA algorithm for the £/Dollar series. In 252 observations we expected 2.5 
observations below the VaR. For the Gaussian, Student t and GED distributions we 
obtained 8, 7 and 5 observations outside the VaR limits, respectively. We note also 
that the VaR estimates follow very well the volatility in the market and reacts well 
to extreme down movements (large negative return values). 

Figure [6] around here 

As for the Ganadian-Dollar/Dollar series we note from Figure [7] that, qualitively 
the results for the Gaussian and GED errors are better and we obtained 2 observa¬ 
tions outside the VaR limits in both cases. The VaR’s for Student’s t errors on the 
other hand are quite large (unnecessarily large from a financial viewpoint). This was 
indeed expected given the estimates of u in Table 5. The estimate of (3 is also large 
compared to Gaussian and GED errors. In our empirical experience, it is usually 
better to work with GED distributions instead of Student’s t. 

Eigure [7] around here 


6 Conclusions 

In this paper we discuss a Bayesian estimation of the stochastic volatility model with 
Gaussian and two heavy-tailed distributions: GED and Student’s t. Specifically, we 
implemented the Metropolis adjusted Langevin (MALA) and Riemann Manifold 
MALA algorithms. Since the volatility has dimension equal to the sample size, the 
computational time could be high in real-life applications. Then we implemented 
a hybrid method: MMALA estimation for the parameters and MALA for sampling 
volatilities. These methods were assessed in simulated data and time series returns. 

As in any Metropolis-Hustings like algorithm, our hybrid sampling scheme may 
be sensitive to the choice of the step size parameter e. Tunning the sampler is simply 
unavoidable in practice and we recommend trying two different tuning parameters 
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during the burn-in period and the stationary phase of the Markov chain (from which 
the final sample will be collected). 
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A Appendix 


In this appendix we present the expressions of gradients and matrix tensors needed 
for the implementation of MALA and MM ALA for GED and Student’s t errors. 
For the Gaussian case see iGirolami and GalderheadI (j201ll L In what follows, let 
et = /3~^ ex.p{-ht/ 2 )yt. 


A.l For GED errors 
Sampling volatilities 

The target function is proportional to 

(1 - </>^) .2 1 


Lh = -- 


2(72 




t=2 


t=l 


t=l 


therefore the gradient VhLh = = s — r where s = (si,...,s„) and r = 

(ri,..., r„) assume values 


A 


, i = l,...,n 


1 u 

Si —-— 

2 4 

n = -^{hi-4>h2), Tn = ^{hn - (phn-l), 


‘Ti = (l)hi)], i = 2 ,...,n-l. 


a 


On the other hand the matrix tensor is a symmetric tridiagonal matrix with elements 
Gh{i,j) = for i,j = l,...,n, 

Gh{i,i) = 7 +A, i = l,n 
4 cj^ 

Gh{i,i) = jH * = 2, —1 

4 cj^ 

Ghii,i + 1) = -i, i = 


Sampling parameters 

Here Ly\Q = ln[f{y,h\e)], i.e. 


Ly \0 = - ln(l — — nln{a) — nln(/3) — — E /t? — 


1 "■ 

I ^\£t 




t=2 


t=l 


13 












The partial derivatives of this log-density with respect to the transformed parameters 
{S,-f,a,p) are, 


dL 


y\s 


d6 


dL 


y\9 


= —n 


= —n 


ly I St 

+ 2^1 

t=l 

+ ^{1- (tP‘)hl + \ '^{ht - 

rr^ rr^ 


d'y 

dLy\0 
da 

dLy\o 
dp 

where 

In addition, 


t=2 

—4> + -^(1 — 4>‘^)hi + - - ht-i{ht — 

cr^ CJ^ ^^ 

t=2 


n 


v-v{ + V'(l/z^) + ln(2) 


E 


E 


E 


' d‘^L 


y\8 


dd^ 

'd'^L 


y\s 


\ 


dddp I 

y\9 


'd‘^L 


572 

'd'^L 


y\8 


do? 

'd^Ly\g' 


9p2 


1 

1 ££ 

2 ^ It 

t=l 


In 


£t 


— V 


z/ dA\ 


V dX 
A dv 


= —nv, E 


= ln(2) - + ^V^(3/i^). 


'd‘^L 


y\8 


dSd-y 


= E 


'd‘^L 


y\d 


85 da 


= 0 


n <j 1 + + 1/z^) + ln(2) - V ( 


= —2n, E 


(LLi\ 

y d^da j 

- 24 ? - 


= - 24 , E 


E 


(d^\ 

\ dldp j 

ld^\ 

y dadp j 


= 0 


= 0 


= —nv 


'dXV 




where and 4 respectively, the digamma and trigamma functions. 


Now let Lg = ln7r(0) = ln[f ( 4 , 4 , 0 ', 12 )]. Then 

dLg dig 1 dLg 1 dLg 4 

lif" ’ w = = 

and the expectations of the second order derivatives of Lg are given by. 


d‘^Le 

972 


1 


o^ 


E 


d^Lg 

da^ 




E 


( d^Lg 

y (9p2 


4 

u 
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and zero elsewhere. Finally, we use Vg In / = and Gq = —E — 



A.2 For t-Student errors 

Next we present those expressions which are different compared with the GED case. 


Sampling volatilities 

The target function is proportional to 


Lh = - 


2ct2 


2(j2 


'^{ht - 4>ht-if - 


(^^ + 1) 


^ln(l + 


t=2 


t=l 


t=l 


u-2 


_ 1 l(z^ + l) ef 

2^ 2{u-2)l + £y{v-2y 


i = 1,... ,n 


Gh{i,i) 

Gfi (i, i) 


2(1/+ 3) 


2(i/ + 3) cr^ 


1 

H-TT, i = l,n 

H ^(l + 0^)) * = 2, 


n — 1 


Sampling parameters 

Here Ly\Q = ln[f{y,h\e)], 

Ly\e = ^ln(l-0^)-raln(o-)-nln(/3)- ^ hj - ^ ^{ht - (pht-if 

- I - 2) + " >“ r (^ + 5) - n to r (0 - h±il E to (1 + 

Let p = ln(z/ — 4) 


2 


{u- 


dLy\g 

d(5 

dLy\g 

4) dp 


n 1 /+ 1 e?/(i/ —2) 





^ln(l+4/(i^-2)) 

t=i 


(z/ + 1) e\l(v - 2) 
(i/-2)^1 + 4/(z/-2) 
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2ni> 
1/ + 3 


E 



E 



E 



—Qn{v — 4) 

{y — 2)(i^ + 1)(^' + 3) 

n {u-Af f (^-3)(z. + 4) {^-2f f 1\ 

2{u-2Y\{v + 1){v + ?,) 2 y ^\2 2 ) 


V’l 



Finally, fl = E(^^)=-A(^-4)^ 
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Table 1: Monte Carlo experiments. Bias and square root of the mean squared 
error of posterior means. Parameters: /3 = 0.65, (p = 0.98, a = 0.15 and u = 1.6 
(for GED) and v = 7 (for Student’s t). 


Errors 

Method 

d 

bias 

smse 

</> 

bias 

smse 

bias 

(7 

smse 

V 

bias 

smse 

Gaussian 

MALA 

-0.001 

0.038 

-0.022 

0.028 

0.051 

0.056 




MMALA 

0.024 

0.038 

-0.011 

0.015 

0.000 

0.014 



GED 

MALA 

-0.002 

0.032 

-0.042 

0.051 

0.090 

0.099 

-0.011 

0.128 


MMALA 

0.002 

0.029 

-0.027 

0.032 

0.050 

0.054 

0.048 

0.115 

Student’s t 

MALA 

-0.003 

0.031 

-0.063 

0.072 

0.122 

0.131 

0.912 

2.311 


MMALA 

-0.010 

0.030 

-0.101 

0.107 

0.180 

0.185 

0.287 

1.428 
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Table 2: Monte Carlo experiments. Bias and square root of the mean squared 
error of posterior means. Parameters: /3 = 0.65, (p = 0.98, a = 0.05 and i' = 1.6 
(for GED) and u = 7 (for Student’s t). 


Errors 

Method 

/3 

bias 

smse 

4 > 

bias 

smse 

bias 

a 

smse 

bias 

P 

smse 

Gaussian 

MALA 

-0.007 

0.019 

-0.194 

0.211 

0.152 

0.153 




MMALA 

-0.007 

0.023 

-0.067 

0.071 

0.085 

0.086 



GED 

MALA 

-0.012 

0.022 

-0.196 

0.210 

0.199 

0.205 

0.059 

0.142 


MMALA 

-0.013 

0.025 

-0.107 

0.112 

0.132 

0.133 

0.109 

0.152 

Student’s t 

MALA 

-0.014 

0.027 

-0.193 

0.205 

0.231 

0.238 

2.163 

3.145 


MMALA 

-0.020 

0.030 

-0.199 

0.205 

0.256 

0.260 

1.419 

2.156 
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Table 3: Comparison of methods: MMALA, INLA 
and MC (Jacquier et ah,1994) for Gaussian errors. 
MMALA and INLA under the same conditions. MC 
used n = 500 and a = 0.0614 instead 0.05 and a = 
0.166 instead 0.15. 



a 

Method 

0 

bias 

smse 

a 

bias 

smse 

0.98 

0.15 

MMALA 

-0.011 

0.015 

0.000 

0.014 



INLA 

-0.011 

0.017 

0.575 

0.586 



MC 

-0.010 

0.020 

-0.064 

0.080 

0.98 

0.05 

MMALA 

-0.067 

0.071 

0.085 

0.086 



INLA 

-0.074 

0.120 

0.238 

0.245 



MC 

-0.070 

0.127 

-0.079 

0.099 
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Table 4: Descriptive Statistics, n is the number of obser¬ 
vations 


Time Series 

n 

Mean 

Std Dev 

Skewness 

Kurtosis 

£/USD 

945 

-0.0353 

0.7111 

0.60 

7.85 

CAN/USD 

2509 

-0.0168 

0.6380 

0.14 

6.18 
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Table 5: Estimation of stochastic volatility models. Posterior means and standard devia¬ 
tions (in parentheses). 


Time Series Method Errors 


£/USD MALA Gaussian 

GED 

Student’s t 
MMALA Gaussian 
GED 

Student’s t 

CAN/USD MALA Gaussian 

GED 

Student’s t 
MMALA Gaussian 
GED 

Student’s t 


0.6156 (0.0115) 0.9824 (0.0042) 
0.3351 (0.0056) 0.9980 (0.0008) 
0.6353 (0.0136) 0.9827 (0.0043) 
0.6311 (0.0146) 0.9847 (0.0052) 
0.6095 (0.0157) 0.9920 (0.0036) 
0.9832 (0.2201) 0.9875 (0.0046) 
0.5524 (0.0066) 0.9873 (0.0022) 
0.5546 (0.0069) 0.9875 (0.0022) 
0.5699 (0.0071) 0.9905 (0.0019) 
0.5579 (0.0079) 0.9921 (0.0023) 
0.5701 (0.0089) 0.9853 (0.0032) 
0.8182 (0.1503) 0.9895 (0.0027) 


0.0903 

(0.0016) 



0.0904 

(0.0014) 

2.0572 

(0.1118) 

0.0841 

(0.0015) 

10.5511 

(1.8144) 

0.0752 

(0.0017) 



0.0665 

(0.0015) 

1.6538 

(0.1047) 

0.0584 

(0.0013) 

4.7574 

(0.4305) 

0.0812 

(0.0009) 



0.0839 

(0.0009) 

1.7670 

(0.0590) 

0.0606 

(0.0006) 

12.6578 

(2.0301) 

0.0628 

(0.0009) 



0.0815 

(0.0011) 

1.7311 

(0.0777) 

0.0631 

(0.0027) 

5.1043 

(0.9192) 
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Figure 1: Pound/Dollar time series returns. 
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Figure 2: Canadian dollar/Dollar time series returns. 
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Figure 3: Sample autocorrelations, sample paths and marginal posterior densitieso 
for the CAN/USD series using the MMALA sampling scheme under GED errors. 
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Figure 4: Absolute returns for the Pound/Dollar series and estimated volatilities 
using MMALA under the three different errors. 
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Figure 5: Absolute returns for the Canadian Dollar/Dollar series and estimated 
volatilities using MMALA under the three different errors. 
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Figure 6: 99% Value at risk of Pound/Dollar exchange rates using the MMALA 
scheme. 
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Figure 7: 99% Value at risk of Canadian-Dollar/Dollar exchange rates using the 
MMALA scheme. 
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